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DETAILED ACTION 
Requirement for Irtfbrmation 

[1] Applicant and the assignee of this application are required under 37 CFR 1.105 to provide 
the following information that the examiner has determined is reasonably necessary to the 
examination of this application. 

1 . In response to this requirement, please provide the tide, citation and copy of each 
publication that any of the applicants relied upon to develop the disclosed subject matter 
that describes the applicant's invention, particularly as to (1) switching between high and low 
resolution images (see fig. 3) and (2) generating high frequency component of the estimated high-resolution 
image by performing motion compensation (see fig. 9). For each publication, please provide a concise 
explanation of the reliance placed on that publication in the development of the disclosed 
subject matter. 

2. In response to this requirement, please provide the tide, citation and copy of each 
publication that any of the applicants relied upon to draft the claimed subject matter. For 
each publication, please provide a concise explanation of the reliance placed on that 
publication in distinguishing the claimed subject matter from the prior art. 

[2] The applicant is reminded that the reply to this requirement must be made with candor and 
good faith under 37 CFR 1.56. Where the applicant does not have or cannot readily obtain an item 
of required information, a statement that the item is unknown or cannot be readily obtained may be 
accepted as a complete reply to the requirement for that item. 
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[3] This requirement is an attachment of the enclosed Office action. A complete reply to the 
enclosed Office action must include a complete reply to this requirement. The time period for reply 
to this requirement coincides with the time period for reply to the enclosed Office action. 

Claim Rejections - 35 USC § 112 

[4] Claims 1, 2 and 10 are rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant regards as 
the invention. 

Regarding claim 1, Examiner suggests the following correction, "a remapper for mapping 
said high spatial frequency component to generate a motion-compensated high spatial 
frequency component estimate of said low resolution image frame". 

Regarding claim 2, Examiner suggests the following correction, "a controller for controlling 
said adding of said motion-compensated high spatial frequency". 

Regarding claim 10, Examiner suggests the following correction, "remapping said high 
spatial frequency component to obtain a motion-compensated high spatial frequency 
component estimate of said low resolution image frame". 



Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

[5] Claims 1, 3, 4, 5, 10, 12, 13 and 14 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Parke 1 in view of Turner" et al. ("Turner"). 

Regarding claim 1, Parke discloses the following claim limitations: 

A system for reconstructing a high resolution image (Le. high resolution output) from at 
least one image sequence of temporally related high (Le. 220) and low (Le. 210) 
resolution image frames, each of said high resolution image frames including a low 
spatial frequency component and a high spatial frequency component (fig. 2; coi 5, 11. 
5-10], said system comprising: a [first spatial interpolator] adapted to generate a low 
spatial frequency (Le. 211) component from a low resolution image frame (Le. 210) of 
said at least one image sequence [fig. 2; coi 4, 11. 47-61]; a [high spatial frequency 
component generator] for generating a high spatial frequency (Le. 221) component 
from at least one high resolution image frame (Le. 220) of said at least one image 
sequence, said at least one high resolution image frame being closely related to said 
low resolution image frame [fig. 2, col. 5, U. U10]\ an [adder] (Le. 230) for adding said 
motion - compensated high spatial frequency component estimate (i.e. temporally 
interpolated high resolution frames, which have been high pass filtered) of said low resolution 
image frame to said generated low spatial frequency component (Le. spatially 
interpolated low resolution images, which have been low pass filtered) of said low resolution 
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image frame to form a reconstructed high resolution image (Le. high resolution output) 
of said low resolution image frame (fig. 2; coi 6, IL 40-55]. 
Parke does not explicitly disclose the following claim limitations (emphasis added): 

a [remapper] for mapping said high spatial frequency component to a motion- 
compensated high spatial frequency component estimate of said low resolution 
image frame; and 

However, in the same field of endeavor Turner discloses the deficient claim limitations, as 
follows: 

A remapper for mapping a high resolution image to generate a motion-compensated 
(i.e. move pixels based on motion vector) high resolution image [col. 4, IL 60-67; col. 5, 11. 14- 
23]. 

It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify Parke's temporal interpolation to include motion compensation as taught by Turner's 
temporal interpolation, the motivation being to generate images of a moving scene [col. 1, 11. 
56-60]. 

Regarding claim 3, Parke and Turner meet the claim limitations, as follows: 

The high resolution image reconstruction system of claim 1, wherein said first spatial 
interpolator utilizes a bicubic upsampling algorithm [Bicubic upsampling is notoriously 
well-known. Official Notice is taken. See Zavaljevskt et al. at col. 4, IL 1-5 for evidence]. 

Regarding claim 4, Parke and Turner meet the claim limitations, as follows: 
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The high resolution image reconstruction system of claim 1, wherein said first spatial 
interpolator utilizes a bilinear upsampling algorithm [Bilinear upsampling is notoriously 
well-known. Official Notice is taken. See Zavaljevskt et ai at col 4, 11 1-5 for evidence.]. 

Regarding claim 5, Parke and Turner meet the claim limitations, as follows: 

The high resolution image reconstruction system of claim 1, wherein said first spatial 
interpolator utilizes a least squares error minimization algorithm [Least squares error 
interpolation is notoriously well-known. Official Notice is taken. See Zavaljevskf et al. at col. 4, 
11. 1-5 for evidence.]. 

Regarding claims 10, 12, 13 and 14 all claimed limitations are set forth and rejected as per 
discussion for claims 1, 3, 4 and 5. 

[6] Claims 2 and 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over Parke in 
view of Turner further in view of Burt ,v et al. ("Burt"). 

Regarding claim 2, Parke and Turner meet the claim limitations as set forth in claim 1. 

Parke and Turner do not explicitly disclose the following claim limitations: 

The high resolution image reconstruction system of claim 1, further comprising a 
[controller] said adding of said motion-compensated high spatial frequency 
component estimate of said low resolution image frame to said generated low spatial 
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frequency component of said low resolution image frame to optimize motion 
confidence. 

However, in the same field of endeavor Burt discloses the deficient claim limitations, as , 
follows: 

A controller controlling (i.e. through alignment parameters) the adding (i.e. fusion) of input 
image and the mosaic to optimize motion confidence [col. 10, 11. 16-23; col. 11, 11. 45- 
50]. 

It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Parke and Turner with Burt to apply weighted the alignment 
parameters according to motion confidence values, the motivation being remove influence 
of erred motion vectors [col 10, 11 16-23]. 

Regarding claim 1 1 all claimed limitations are set forth and rejected as per discussion for 
claim 2. 

[7] Claims 6 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable over Parke in 
view of Turner further in view of GnessF et al. ("Griessl"). 

Regarding claim 6, Parke and Turner meet the claim limitations as set forth in claim 1. 

Parke and Turner do not explicitly disclose the following claim limitations: 

The high resolution image reconstruction system of claim 1, wherein said high spatial 
frequency component generator includes a downsampler for downsampling at least 
one high resolution image frame of said at least one image sequence. 
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However, in the same field of endeavor Griessl discloses the deficient claim limitations, as 
follows: 

A downsampler (i.e. MotionVyramid) for downsampling at least one high resolution 

image frame [cot. 6, IL 1-27]. 
It would have been obvious to one with ordinary skill in the art at the time of invention to 
modify the teachings of Parke and Turner with Griessl to downsample the high resolution 
image frame, the motivation being to perform hierarchical motion vector calculation [cot. 4, 
IL 60-65]. 

Regarding claim 15 all claimed limitations are set forth and rejected as per discussion for 
claim 6. 

Allowable Subject Matter 

[8] Claims 7-9 and 16-18 are objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the base claim 
and any intervening claims. 

Contact Information 

[9] Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Mr. Sath V. Perungavoor whose telephone number is (571) 272-7455. The 
examiner can normally be reached on Monday to Friday from 8:30am to 5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Mr. Matthew C. Bella whose telephone number is (571) 272-7778, can be reached on Monday to 
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Friday from 9:00am to 5:00pm. The fax phone number for the organi2ation where this application 
or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR system, 
see http:/ /pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, 
contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Dated: March 21,2007 



Matthew C. Bella 
Sath V. Perungavoor 
Telephone: (571) 272-7455 
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